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Chapter One: Overview of Recommendations 



Introduction 

S ince 1973, the National Assessment of Edueational Progress (NAEP) has gathered 
information about student aehievement in mathematies. The results of these 
periodie assessments, produeed in print and Web-based formats, inform eitizens 
about the nature of students’ eomprehension of the subjeet, inform eurrieulum 
speeialists about the level and nature of student understanding, and inform polieymakers 
about faetors related to sehooling and its effeet on student profieieney in mathematies. 

Based on these surveys of students at the elementary, middle sehool, and high sehool 
levels, NAEP has provided eomprehensive information about what students in the 
United States know and ean do in the area of mathematies, as well as in a number of 
other subjeet areas. These reports present information on strengths and weaknesses in 
students’ understanding and their ability to apply that understanding in problem-solving 
situations; provide eomparative student data aeeording to raee/ethnieity, type of 
eommunity, and geographie region; deseribe trends in student performanee over time; 
and report on relationships between student profieieney and eertain baekground 
variables. 

This doeument eontains the framework and a set of reeommendations for the NAEP 
2007 mathematies assessment, whieh will assess student aehievement nationally and 
state-by-state, as well as in seleet urban distriets, in grades 4 and 8. It ineludes 
deseriptions of the mathematieal eontent of the test, the types of test questions, and 
reeommendations for administration of the test. In broad terms, this framework attempts 
to answer the question, “What should be assessed?” The answer to this question must 
neeessarily eonsider the eonstraints of a large-seale assessment sueh as NAEP, with its 
limitations on time and resourees. 

It is important to understand that this doeument does not attempt to answer the 
question, “What should be taught, or how?” This is an assessment framework, not a 
eurrieulum framework. It was developed with the understanding that some eoneepts, 
skills, and aetivities in sehool mathematies are not suitable to be assessed on NAEP, 
even though they may be important eomponents of a sehool eurrieulum (e.g., an 
extended projeet that involves gathering data, or a group projeet). 

The Assessment and Item Specifications for the 2005 NAEP Mathematics Assessment, 
a eompanion doeument to this framework, gives more detail about the items and 
eonditions for the NAEP mathematies assessment. 

Context for Planning the Assessment 

The National Assessment Governing Board, ereated by Congress in 1988, is 
responsible for formulating poliey for NAEP. The Governing Board is speoifieally 
eharged with developing assessment objeetives and test speeifieations, identifying 
appropriate aehievement goals for eaeh age and grade, and earrying out other NAEP 
poliey responsibilities. 
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Congress also authorized the trial state assessment program in 1988. This voluntary 
program for gathering state-level aehievement data in mathematies began with the 1990 
assessment at grade 8, and with the 1992 assessment in grade 4. National data at grades 
4, 8, and 12 were also gathered during those years. 

In preparation for the 1990 mathematies assessment, a eontraet was awarded to the 
Couneil of Chief State Sehool Offieers (CCSSO) to design a framework for the 
assessment. The CCSSO projeet gave special attention to the formal state objectives and 
frameworks for mathematics instruction. State-, district-, and school-level objectives 
were considered, as well as the frameworks on which previous NAEP mathematics 
assessments had been based, and a draft version of the National Council of Teachers of 
Mathematics’ (NCTM’s) Curriculum and Evaluation Standards for School 
Mathematics. The result was a “content by mathematical ability” matrix design that was 
used to guide both the 1990 and 1992 mathematics assessments conducted by NAEP at 
the national and state levels. 

To prepare for the next NAEP mathematics assessment, in 1991 the Governing Board 
awarded a contract to College Board to develop the assessment and item specifications 
for the 1994 mathematics assessment. The College Board project had two primary 
purposes: (1) to recommend a framework in terms of describing what students know and 
can do in mathematics, and (2) to develop specifications for the assessment items, 
specifically the mix of item formats, the item distribution for mathematics content areas, 
and the conditions under which items are presented to students (e.g., use of 
manipulatives, use of calculators, and length of time to complete tasks). 

Taking into account the three NAEP achievement levels adopted by the Governing 
Board — Basic, Proficient, and Advanced — the College Board effort resulted in the 
“content areas by mathematical abilities by mathematical power” grid that was used to 
guide the development of the 1996 and 2000 national and state mathematics assessments 
conducted by NAEP. 

Before the reauthorization of the Individuals with Disabilities Education Act (IDEA) 
in the mid-1990s, participation in NAEP of students with disabilities and English 
language learners was limited, with schools excluding them from the assessment in 
accordance with criteria provided by the program at that time. Eor the 1996 NAEP 
assessment, modifications were made in two areas: inclusion criteria were revised to 
make them more clear, more inclusive, and more likely to be applied consistently across 
jurisdictions in the United States; and a variety of assessment accommodations was 
offered for the first time. 

In 1998, NAEP began new trend lines for some subject areas that presented data 
reported for the first time on samples that included accommodated special-needs 
students. This trend toward more inclusive assessments has also led to a closer look at 
how test items are developed and assessments designed. 

Over the years, NAEP has implemented procedures that are designed to make items 
more accessible for a variety of special-needs students. The NAEP mathematics 
framework enables the continuation of this best practices approach, and the assessment 
and item specifications document (Assessment and Item Specifications for the 2005 
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NAEP Mathematics Assessment) provides clear and detailed guidance on how to 
develop a more inclusive assessment. 

The long-range plan established by the Governing Board called for the development 
of a new mathematics framework to be used as the basis for the 2005 national and state 
assessments of mathematics. Prior to initiating work on a new framework, the 
Governing Board conducted a series of public meetings to gather input to serve as the 
basic purpose(s) for the new framework. At the public meetings, a strong concern was 
raised by states about the need to continue the short-term trend lines for the nation and 
the states. Many states were using the short-term trend lines as an independent monitor 
of their standards-based reform efforts. 

Several other concerns were also raised: 

• Had computational skills been overlooked by the reform efforts because of the 
emphasis placed on higher order skills by most state mathematics standards and 
the work by NCTM? 

• Were U.S. students capable of handling a more rigorous curriculum, especially 
algebra and geometry, at grade 8? 

• What should our mathematical expectations be for grade 12 students? 

Based on the input received, the Governing Board awarded a contract to CCSSO in 
September 2000 to update the mathematics assessment framework used for the 1996 and 
2000 assessments. The revisions were to address the concerns raised at the public 
meetings while maintaining the short-term trend lines in grades 4 and 8 that began with 
the 1990 mathematics assessment. 

It is within this context that the recommendations contained in this document were 
developed. 

The Consensus Approach 

CCSSO established a steering committee, representative of national policy 
organizations, mathematics associations, research mathematicians, business and 
industry, and educators, to develop policy recommendations for the mathematics 
assessment and to guide the direction and scope of the project. A planning committee of 
mathematics educators, mathematicians, curriculum supervisors, and teachers was 
established to draft the content of the framework, working within the policy 
recommendations established by the steering committee. Care was taken with both 
committees to ensure that the diversity of opinion regarding mathematics issues was 
represented and reflected. To reach meaningful consensus, all points of view were heard 
and considered. Such consensus has been the goal of this project. 

A technical advisory panel, composed of university professors, state testing 
specialists, and measurement experts from private research organizations, was 
established to consider the policy recommendations and to draft content from the 
perspective of whether it would threaten NAEP’s ability to continue the short-term 
mathematics trend lines that began in 1990. 
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The steering eommittee and planning eommittee both began their work with a review 
of the framework used in 1996 and 2000. A diseussion of the eurrent debates in 
mathematies edueation was also part of their meetings. In their deliberations, the 
eommittees eonsidered state mathematies eontent standards and frameworks, new 
standards prepared by NCTM, reports from the Third International Mathematies and 
Seienee Study, reports from the Aehieve Projeet, and a 2001 report issued by the 
National Researeh Couneil of the National Aeademy of Seienees. In addition, input was 
provided by mathematies teaehers and supervisors as well as others through CCSSO’s 
partners, the Couneil for Basie Edueation and the Assoeiation of State Supervisors of 
Mathematies. 

The suggested revisions eontained in this framework are intended (1) to refleet reeent 
eurrieular emphases and objeetives; (2) to inelude what various polieymakers, seholars, 
praetitioners, and interested eitizens believe should be in the assessment; (3) to maintain 
the short-term trend lines in grades 4 and 8 that began with the 1990 mathematies 
assessment to permit the reporting of ehanges in student aehievement over time; and (4) 
to inelude objeetives that are more elear and more speeifie for eaeh grade level. 

Achievement Levels 

The NAEP Mathematies Eramework was eonsidered in light of the three NAEP 
aehievement levels: Basic, Proficient, and Advanced. Basic denotes partial mastery of 
prerequisite knowledge and skills that are fundamental for profieient work at eaeh 
grade. Proficient represents solid aeademie performanee for eaeh grade assessed. 
Students reaehing this level have demonstrated eompeteney over ehallenging subjeet 
matter, ineluding subjeet-matter knowledge, applieation of sueh knowledge to real- 
world situations, and analytieal skills appropriate to the subjeet matter. Advanced 
represents superior performanee. 

These levels are intended to provide deseriptions of what students should know and 
be able to do in mathematies. Established for the 1992 mathematies seale through a 
broadly inelusive proeess and adopted by the Governing Board, the three levels per 
grade are a major means of reporting NAEP data. The updated mathematies framework 
was developed to ensure eongruenee between the aehievement levels and the test 
eontent. See appendix A for the NAEP Mathematies Aehievement Eevel Deseriptions. 

Recommendations for the NAEP Mathematics Assessment 

As a result of analysis and review, the steering eommittee and planning eommittee 
endorsed the following reeommendations for the NAEP mathematies assessment: 

1. Content Areas 

The NAEP mathematies assessment should be based on essentially the same five 
eontent areas as the 1996 and 2000 assessments: (1) Number Properties and Operations, 
(2) Measurement, (3) Geometry, (4) Data Analysis and Probability, and (5) Algebra. 
Details about eaeh of these eontent areas ean be found in ehapter three. 
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2 , Mathematical Complexity of Items 

The second dimension of the framework, formerly known as “mathematical abilities,” 
should be refined to describe the level of mathematical complexity that an item demands 
of a student. Each level describes the degree of procedural knowledge, conceptual 
understanding, problem solving, reasoning, or communicating required to respond to an 
item at that level. Further description of how this revision relates to the former 
framework is presented in chapter two, and the levels are described at length in chapter 
four. 

3, Distribution of Items 

The percentage of items allotted to each of the five content areas should remain the 
same at grade 4 as called for in the framework for the 1996-2005 assessments. The 
percentages for grade 8 should be altered somewhat in the areas of Number Properties 
and Operations and Algebra to reflect the increasing importance of algebraic concepts. 
At grade 12, the percentages should be changed to more closely correspond to the 
mathematics that high school students experience in a typical 3-year sequence of 
courses, with algebra and geometry/measurement forming the anchors, along with an 
increasing emphasis on data analysis and probability. The recommended percentages are 
discussed in chapter two. 

4, Item Formats 

Given that NAEP is a paper-and-pencil test administered in a timed setting (for 
students not receiving accommodations), the assessment should continue to use three 
types of items: multiple choice, short constructed response, and extended constructed 
response. As in the previous framework, approximately half of a student’s testing time 
should be allotted to multiple-choice items, with the remaining half devoted to 
constructed-response items of both types. Further description of the item formats can be 
found in chapter five. For items with multiple-score points, students receive full credit 
only if they fulfill all the requirements of the item and provide the correct solution. 

5, Manipulatives 

The assessment should continue to use reasonable manipulative materials, where 
possible, in measuring students’ ability to represent their understandings and to use tools 
to solve problems. Such manipulative materials and accompanying tasks should be 
carefully chosen to cause minimal disruption of the test administration process. 

6, Calculators 

It is appropriate for some portions (two-thirds) of NAEP at all grade levels to assess 
students’ mathematical knowledge and skills without access to a calculator, but for other 
portions (one-third) of the test to allow the use of a calculator. At grade 4, a four- 
function calculator should be supplied by NAEP with appropriate training at the time of 
administration. Eighth- and 12th-grade students should be allowed to bring whatever 
calculator, graphing or otherwise, they are accustomed to using in the classroom. 
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The Governing Board determined that eighth-grade students should be provided with 
seientifie ealeulators beginning with the 2005 assessment based on a survey of state 
testing programs. More details and diseussion about the ealeulator reeommendations ean 
be found in ehapter two. 
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Chapter Two: Framework for the Assessment 



T his chapter further diseusses the rationale for reeommendations, espeeially those 
that refleet a ehange from eurrent poliey. 

Content Areas 

Sinee its first mathematies assessments, NAEP has regularly gathered data on 
students’ understanding of mathematieal eontent. Although the names of the eontent 
areas in the frameworks, as well as some of the topies in those areas, may have ehanged 
somewhat from one assessment to the next, there remained a eonsistent foeus toward 
eolleeting information on student performanee in five key areas: 

• Number (ineluding eomputation and the understanding of number eoneepts) 

• Measurement (ineluding use of instruments, applieation of proeesses, and eoneepts 
of area and volume) 

• Geometry (ineluding spatial reasoning and applying geometrie properties) 

• Data Analysis (ineluding probability, graphs, and statisties) 

• Algebraie Representations and Relationships 

The framework for the mathematies assessment is anehored in these same five broad 
areas of mathematieal eontent: 

• Number Properties and Operations 
• Measurement 
• Geometry 

• Data Analysis and Probability 
• Algebra 

These divisions are not intended to separate mathematies into diserete elements. 
Rather, they are intended to provide a helpful elassifieation seheme that deseribes the 
full speetrum of mathematieal eontent assessed by NAEP. Classifying items into one 
primary eontent area is not always elear out, but doing so brings us oloser to the goal of 
ensuring that important mathematieal eoneepts and skills are assessed in a balanoed 
way. 

At grade 12, the five eontent areas are oollapsed into four, with geometry and 
measurement oombined into one. This refieots the faot that the majority of measurement 
topies suitable for 12th-grade students are geometrioal in nature. 

It is important to note that oertain aspeots of mathematies ooour in all of the eontent 
areas. The best example of this is eomputation. Computation is the skill of performing 
operations on numbers. It should not be eonfused with the eontent area of NAEP ealled 
Number Properties and Operations, whieh eneompasses a wide range of eoneepts about 
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our numeration system (see ehapter three for a thorough diseussion). Certainly the area 
of Number Properties and Operations ineludes a variety of eomputational skills, ranging 
from operations with whole numbers to work with deeimals and fraetions and finally 
real numbers. But eomputation is also eritieal in Measurement and Geometry, sueh as in 
ealeulating the perimeter of a reetangle, estimating the height of a building, or finding 
the hypotenuse of a right triangle. Data analysis often involves eomputation, sueh as 
ealeulating a mean or the range of a set of data. Probability often entails work with 
rational numbers. Solving algebraie equations usually involves numerieal eomputation 
as well. Computation, therefore, is a foundational skill in every eontent area. 

Mathematical Complexity of Items 

The framework used for the 1996 and 2000 NAEP ineluded three dimensions: 
mathematieal eontent, mathematieal abilities, and power (reasoning, eonneetions, and 
eommunieation). That framework was intended to address the primary need of ensuring 
that NAEP assessed an appropriate balanee of mathematieal eontent and at the same 
time assessed a variety of ways of knowing and doing mathematies. The abilities and 
power dimensions were not intended for reporting, but rather to provide for a wide 
range of mathematieal aetivity in the items. 

That framework had many laudable features. Notions of eoneeptual understanding, 
proeedural knowledge, and problem solving sent a strong message about the depth and 
breadth of engaging in mathematieal aetivity. The dimensions of mathematieal power 
gave further emphasis to the idea that eertain aetivities eut aeross eontent areas. At the 
same time, there was an aeknowledgement that the dimension of mathematieal abilities 
proved somewhat diffieult for experts to agree on, relying as it does on inferenees about 
students’ approaehes to eaeh partieular item. 

The intent of this eurrent framework is to build on the previous one, retaining its 
strengths while addressing some of its weaknesses. The purpose remains the same: to 
ensure that NAEP assesses an appropriate balanee of eontent as well as a variety of 
ways of knowing and doing mathematies. The major ehange is to ereate a seeond 
dimension of the framework based on the properties of an item, rather than on the 
abilities of a student. Mathematieal eomplexity of an item answers the question, “What 
does the item ask of the students?” 

Eaeh level of eomplexity ineludes aspeets of knowing and doing mathematies, sueh 
as reasoning, performing proeedures, understanding eoneepts, or solving problems. The 
levels are ordered, so that items at a low level would demand that students perform 
simple proeedures, understand elementary eoneepts, or solve simple problems. Items at 
the high end would ask students to reason or eommunieate about sophistieated eoneepts, 
perform eomplex proeedures, or solve non-routine problems. Ordering of the levels is 
not intended to imply a developmental sequenee or the sequeneing in whieh teaehing or 
learning oeeurs. Rather, it is a deseription of the different demands made on students by 
partieular test items. See ehapter five for further diseussion of the levels of mathematieal 
eomplexity. 
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Distribution of Items 

The distribution of items among the various mathematieal eontent areas is a eritieal 
feature of the assessment design, as it refleets the relative importanee and value given to 
eaeh of the eurrieular eontent areas within mathematies. As has been the ease with past 
NAEP assessments in mathematies, the eategories have reeeived differential emphasis at 
eaeh grade, and the differentiation eontinues in the framework for this assessment. Table 
1 provides the reeommended balanee of items in the assessment by eontent area for eaeh 
grade (4, 8, and 12) in this assessment. Note that the pereentages refer to numbers of 
items, not the amount of student testing time (see ehapter five for reeommendations on 
item formats and student testing time). 

Table 1. Percentage Distribution of Items by Grade and Content Area 



Content Area (2005) 


Grade 4 (%) 


Grade 8 (%) 


Grade 12 (%) 


Number Properties and Operations 


40 


20 


10 


Measurement 


20 


15 


30 


Geometry 


15 


20 


Data Analysis and Probability 


10 


15 


25 


Algebra 


15 


30 


35 



The pereentages in grade 4 are not different from those reeommended in the previous 
framework. Change was not reeommended, as these numbers eontinue to be a 
reasonable refieetion of the relative weights of eaeh of these eontent areas at that grade 
level. 

At grade 8, new number eoneepts oeeur in the form of more advaneed work with 
properties and operations on rational numbers (fraetions and deeimals) and more 
sophistieated work in number theory. However, mueh of the work in numbers happens 
in the eontext of other eontent areas, sueh as Measurement and Data Analysis and 
Probability. Grade 8 also has an inereased emphasis on informal algebraie eoneepts and 
on Geometry. Therefore, the pereentages show a slight inerease in Algebra and a 
eorresponding slight deerease in Number Properties and Operations at grade 8 eompared 
with the pereentages of the previous framework. 

More students are taking higher levels of mathematies in high school. According to 
data from the 2000 NAEP, approximately 79 percent of 12th-grade students have taken 
the equivalent of 2 years of algebra and 1 year of geometry. Because NAEP needs to 
assess the full range of content in mathematics, the percentages for 12th grade have 
been adjusted, with primary emphasis on Geometry/Measurement and Algebra. At this 
grade level, the majority of measurement topics are geometrical in nature and the 
distinction between Geometry and Measurement becomes blurred, so this framework 
calls for these two content areas to be combined into one. The percentages also show the 
increased importance of Data Analysis and Probability in the secondary school 
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curriculum. The majority of work in Number Properties and Operations is done in the 
eontext of the other eontent areas, so it reeeives a deereased emphasis. 

Calculators 

At eaeh grade level, approximately two-thirds of the assessment measures students’ 
mathematical knowledge and skills without aecess to a ealculator; the other third of the 
assessment allows the use of a ealeulator. The assessment eontains bloeks for which 
calculators are not allowed, and ealeulator bloeks, whieh eontain some items that would 
be diffieult to solve without a ealeulator. The type of ealeulator students may use on a 
ealeulator block varies by grade level, as follows: 

• At grade 4, a four-funetion ealculator is supplied to students, with training at the 
time of administration. 

• At grade 8, a scientifie ealeulator is supplied to students, with training at the time 
of administration. 

No items at grade 8 will be designed to provide an advantage to students with a 
graphing calculator. The estimated time required for any item should be based on the 
assumption that students are not using a graphing ealeulator. 

In determining whether an item belongs on a ealeulator bloek or a non-ealculator 
bloek, the developer should eonsider the teehnology available to students and the 
measurement intent of the item. The eontent and skills being assessed should guide 
whether an item should be eonsidered ealeulator aetive and whether it should go in a 
ealculator block. For example, a multiple-choice item asking students to seleet the graph 
that represents a given equation should be on a non-ealculator block, if the intent of the 
item is to measure students’ ability to reeognize the graph of a given equation and if the 
equation is in a form that is readily entered into a graphing ealeulator to obtain a graph 
(for example, y = -x^). 
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I n order to describe the specific mathematics that should be assessed at each grade 
level, it is necessary to organize the domain of mathematics into component parts. 
This is accomplished by using the five content areas, as described in chapter two. 
Though such an organization brings with it the danger of fragmentation, the hope is that 
the objectives and the test items built on them will, in many cases, cross some of the 
boundaries of these content areas. 

One of the goals of this framework is to provide more clarity and specificity in the 
objectives for each grade level. To accomplish this, a matrix was created that depicts the 
particular objectives that are appropriate for assessment under each subtopic. Within 
Number, for example, and the subtopic of Number Sense, specific objectives are listed 
for assessment at grade 4 and grade 8. The same objective at different grade levels 
depicts a developmental sequence for that concept or skill. An empty cell in the matrix 
is used to convey the fact that a particular objective is not appropriate for assessment at 
that grade level. 



In order to fully understand the objectives and their intent, please note the 

following: 

• Further clarification of some of these objectives, along with some sample items, may 
be found in the companion document. Assessment and Item Specifications for the 
2005 NAEP Mathematics Assessment. 

• While all test items will be assigned a primary classification, some test items could 
potentially fall into more than one content area or more than one objective. 

• When the word “or” is used in an objective, it should be understood as inclusive; that 
is, an item may assess one or more of the concepts included. However, all concepts 
described should be measured across the full range of the assessment. 

• These objectives describe what is to be assessed on the 2007 NAEP. They should not 
be interpreted as a complete description of mathematics that should be taught at these 
grade levels. 



Mathematical Content Areas 

Number Properties and Operations 

Numbers are our main tools for describing the world quantitatively. As such, they 
deserve a privileged place in this framework. With whole numbers, we can count 
collections of discrete objects of any type. We can also use numbers to describe 
fractional parts and even to describe continuous quantities such as length, area, volume, 
weight, and time, and more complicated derived quantities such as rates, speed, density, 
inflation, interest, and so forth. Thanks to Cartesian coordinates, we can use pairs of 
numbers to describe points in a plane or triples of numbers to label points in space. 
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Numbers let us talk in a preeise way about anything that ean be counted, measured, or 
located in space. 

Numbers are not simply labels for quantities. They form systems with their own 
internal structure. The arithmetic operations (addition and subtraction, multiplication 
and division) help us model basic real-world operations. For example, joining two 
collections, or laying two lengths end to end, can be described by addition, while the 
concept of rate depends on division. Multiplication and division of whole numbers lead 
to the beginnings of number theory, including concepts of factorization, remainder, and 
prime number. Besides the arithmetic operations, the other basic structure of the real 
numbers is ordering, as in which is greater and lesser. These reflect our intuitions about 
the relative size of quantities and provide a basis for making sensible estimates. 

The accessibility and usefulness of arithmetic are greatly enhanced by our efficient 
means for representing numbers: the Hindu-Arable decimal place value system. In its 
full development, this remarkable system includes decimal fractions, which let us 
approximate any real number as closely as we wish. Decimal notation allows us to do 
arithmetic by means of simple, routine algorithms, and it makes size comparisons and 
estimation easy. The decimal system achieves its efficiency through sophistication, as 
all the basic algebraic operations are implicitly used in writing decimal numbers. To 
represent ratios of two whole numbers exactly, we supplement decimal notation with 
fractions. 

Comfort in dealing with numbers effectively is called number sense. It includes firm 
intuitions about what numbers tell us; an understanding of the ways to represent them 
symbolically (including facility with converting between different representations); the 
ability to calculate, either exactly or approximately, and by several means (mentally, 
with paper and pencil, or with calculator, as appropriate); and skill in estimation. The 
ability to deal with proportion, including percents, is another important part of number 
sense. 

Number sense is a major expectation of the 2007 NAEP. At fourth grade, students are 
expected to have a solid grasp of whole numbers, as represented by the decimal system, 
and to have the beginnings of understanding fractions. By eighth grade, they should be 
comfortable with rational numbers, represented either as decimal fractions (including 
percents) or as common fractions. They should be able to use them to solve problems 
involving proportionality and rates. Also in middle school, number should begin to 
coalesce with geometry via the idea of the number line. This should be connected with 
ideas of approximation and the use of scientific notation. Eighth graders should also 
have some acquaintance with naturally occurring irrational numbers, such as square 
roots and pi. By 12th grade, students should be comfortable dealing with all types of 
real numbers. 
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Number Properties and Operations 



1) Number sense 


GRADE 4 


GRADE 8 


GRADE 12 


a) Identify the place value and 
actual value of digits in whole 
numbers. 


a) Use place value to model and 
describe integers and decimals. 




b) Represent numbers using models 
such as base 10 representations, 
number lines, and two- 
dimensional models. 


b) Model or describe rational 
numbers or numerical 
relationships using number lines 
and diagrams. 




c) Compose or decompose whole 
quantities by place value (e.g., 
write whole numbers in expanded 
notation using place value: 342 = 
300 +40 + 2). 






d) Write or rename whole numbers 
(e.g., 10: 5 + 5, 12-2,2x5). 


d) Write or rename rational 
numbers. 


d) Write, rename, represent, or 
compare real numbers (e.g., 7t, 
4l , numerical, relationships 
using number lines, models, or 
diagrams. 


e) Connect model, number word, or 
number using various models and 
representations for whole 
numbers, fractions, and decimals. 


e) Recognize, translate between, or 
apply multiple representations of 
rational numbers (fractions, 
decimals, and percents) in 
meaningful contexts. 






f) Express or interpret numbers 
using scientific notation from 
real-life contexts. 


f) Represent very large or very 
small numbers using scientific 
notation in meaningful contexts. 




g) Find or model absolute value or 
apply to problem situations. 


g) Find or model absolute value or 
apply to problem situations. 






h) Interpret calculator or computer 
displays of numbers given in 
scientific notation. 




i) Order or compare rational 
numbers (fractions, decimals, 
percents, or integers) using 
various models and 
representations (e.g., number 
line). 




j) Order or compare whole numbers, 
decimals, or fractions. 


j) Order or compare rational 

numbers including very large and 
small integers, and decimals and 
fractions close to zero. 


j) Order or compare real numbers, 
including very large or small real 
numbers. 



continued on page 14 
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Number Properties and Operations (continued) 



2) Estimation 


GRADE 4 


GRADE 8 


GRADE 12 


a) Use benchmarks (well-known 
numbers used as meaningful 
points for comparison) for whole 
numbers, decimals, or fractions in 
contexts (e.g., 14 and .5 may be 
used as benchmarks for fractions 
and decimals between 0 and 
1.00). 


a) Establish or apply benchmarks 
for rational numbers and common 
irrational numbers (e.g., Jt) in 
contexts. 


a) Establish or apply benchmarks 
for real numbers in contexts. 


b) Make estimates appropriate to a 
given situation with whole 
numbers, fractions, or decimals 
by: 

• knowing when to estimate, 

• selecting the appropriate type 
of estimate, including over- 
estimate, underestimate, and 
range of estimate, or 

• selecting the appropriate 
method of estimation (e.g., 
rounding). 


b) Make estimates appropriate to a 

given situation by: 

• identifying when estimation 
is appropriate, 

• determining the level of 
accuracy needed, 

• selecting the appropriate 
method of estimation, or 

• analyzing the effect of an 
estimation method on the 
accuracy of results. 


h) Make estimates of very large or 
very small numbers appropriate 
to a given situation by: 

• identifying when estimation 
is appropriate or not, 

• determining the level of 
accuracy needed, 

• selecting the appropriate 
method of estimation, or 

• analyzing the effect of an 
estimation method on the 
accuracy of results. 


c) Verify solutions or determine the 
reasonableness of results in 
meaningful contexts. 


c) Verify solutions or determine the 
reasonableness of results in a 
variety of situations including 
calculator and computer results. 


c) Verify solutions or determine the 
reasonableness of results in a 
variety of situations including 
scientific notation, calculator, and 
computer results. 




d) Estimate square or cube roots of 
numbers less than 1 ,000 between 
two whole numbers. 


d) Estimate square or cube roots of 
numbers less than 1,000 between 
two whole numbers. 



continued on page 15 
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Number Properties and Operations (continued) 



3) Number operations 


GRADE 4 


GRADE 8 


GRADE 12 


a) Add and subtract: 

• whole numbers, or 

• fractions with like 
denominators, or 

• decimals through hundredths. 


a) Perform computations with 
rational numbers. 


a) Perform computations with real 
numbers including common 
irrational numbers or the absolute 
value of numbers. 


h) Multiply whole numbers: 

• no larger than two-digit by 
two-digit with paper and pencil 
computation, or 

• larger numbers with use of 
calculator. 






c) Divide whole numbers: 

• up to three-digits by one-digit 
with paper and pencil 
computation, or 

• up to five-digits by two-digits 
with use of calculator. 






d) Describe the effect of operations 
on size (whole numbers). 


d) Describe the effect of multiplying 
and dividing by numbers 
including the effect of 
multiplying or dividing a rational 
number by: 

• zero, or 

• a number less than zero, or 

• a number between zero and 
one, 

• one, or 

• a number greater than one. 


d) Describe the effect of multiplying 
and dividing by numbers 
including the effect of 
multiplying or dividing a real 
number by: 

• zero, or 

• a number less than zero, or 

• a number between zero and 
one, or 

• one, or 

• a number greater than one. 




e) Provide a mathematical argument 
to explain operations with two or 
more fractions. 




f) Interpret whole number operations 
and the relationships between 
them. 


f) Interpret rational number 

operations and the relationships 
between them. 




g) Solve application problems 
involving numbers and 
operations. 


g) Solve application problems 
involving rational numbers and 
operations using exact answers or 
estimates as appropriate. 


g) Solve application problems 
involving numbers, including 
rational and common irrationals, 
using exact answers or estimates 
as appropriate. 



continued on page 16 
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Number Properties and Operations (continued) 



4) Ratios and proportional reasoning 


GRADE 4 


GRADES 


GRADE 12 


a) Use simple ratios to describe 
problem situations. 


a) Use ratios to describe problem 
situations. 






b) Use fractions to represent and 
express ratios and proportions. 


b) Use proportions to model 
problems. 




c) Use proportional reasoning to 
model and solve problems 
(including rates and scaling). 


c) Use proportional reasoning to 
solve problems (including rates). 




d) Solve problems involving 
percentages (including percent 
increase and decrease, interest 
rates, tax, discount, tips, or 
part/whole relationships). 


d) Solve problems involving 
percentages (including percent 
increase and decrease, interest 
rates, tax, discount, tips, or 
part/whole relationships). 


5) Properties of nnmber and operations 


GRADE 4 


GRADES 


GRADE 12 


a) Identify odd and even numbers. 


a) Describe odd and even integers 
and how they behave under 
different operations. 




b) Identify factors of whole numbers. 


b) Recognize, find, or use factors, 
multiples, or prime factorization. 


b) Solve problems involving factors, 
multiples, or prime factorization. 




c) Recognize or use prime and 
composite numbers to solve 
problems. 


c) Use prime or composite numbers 
to solve problems. 




d) Use divisibility or remainders in 
problem settings. 


d) Use divisibility or remainders in 
problem settings. 


e) Apply basic properties of 
operations. 


e) Apply basic properties of 
operations. 


e) Apply basic properties of 
operations. 


f) Explain or justify a mathematical 
concept or relationship (e.g., 
explain why 1 5 is an odd number 
or why 7-3 is not the same as 3- 
7). 


f) Explain or justify a mathematical 
concept or relationship (e.g., 
explain why 17 is prime). 


f) Provide a mathematical argument 
about a numerical property or 
relationship. 
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Measurement 

Measuring is the proeess by which numbers are assigned in order to describe the 
world quantitatively. This process involves selecting the attribute of the object or event 
to be measured, comparing this attribute to a unit, and reporting the number of units. For 
example, in measuring a child, we may select the attribute of height and the inch as the 
unit for the comparison. In comparing the height to the inch, we may find that the child 
is about 42 inches. If considering only the domain of whole numbers, we would report 
that the child is 42 inches tall. However, since height is a continuous attribute, we may 
consider the domain of rational numbers and report that the child is 4‘Vie inches tall (to 
the nearest 16th of an inch). Measurement also allows us to model positive and negative 
numbers as well as irrational numbers. 

This connection between measuring and number makes measuring a vital part of the 
school curriculum. Measurement models are often used when students are learning 
about number and operations. For example, area and volume models can help students 
understand multiplication and the properties of multiplication. Length models, 
especially the number line, can help students understand ordering and rounding 
numbers. Measurement also has a strong connection to other areas of school 
mathematics and to the other subjects in the school curriculum. Problems in algebra are 
often drawn from measurement situations. One can also consider measurement to be a 
function or a mapping of the attribute to a set of numbers. Much of school geometry 
focuses on the measurement aspect of geometric figures. Statistics also provides ways to 
measure and to compare sets of data. These are some of the ways in which measurement 
is intertwined with the other four content areas. 

In this NAEP Mathematics Framework, attributes such as capacity, weight/mass, 
time, and temperature are included, as well as the geometric attributes of length, area, 
and volume. Although many of these attributes are included in the grade 4 framework, 
the emphasis is on length, including perimeter, distance, and height. More emphasis is 
placed on area and angle in grade 8. By grade 12, volumes and rates constructed from 
other attributes, such as speed, are emphasized. 

Units involved in items on the NAEP assessment include non-standard, customary, 
and metric units. At grade 4, common customary units such as inch, quart, pound, and 
hour and the common metric units such as centimeter, liter, and gram are emphasized. 
Grades 8 and 12 include the use of both square and cubic units for measuring area, 
surface area, and volume; degrees for measuring angles; and constructed units such as 
miles per hour. Converting from one unit in a system to another (such as from minutes 
to hours) is an important aspect of measurement included in problem situations. 
Understanding and using the many conversions available is an important skill. There are 
a limited number of common, everyday equivalencies that students are expected to 
know (see the Assessment and Item Specifications document for more detail). 

Items classified in this content area depend on some knowledge of measurement. Eor 
example, an item that asks the difference between a 3 -inch and a U4-inch line segment 
is a number item, while an item comparing a 2-foot segment with an 8-inch line segment 
is a measurement item. In many secondary schools, measurement becomes an integral 
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part of geometry; this is refleeted in the proportion of items reeommended for these two 
areas. 

Measurement 



1) Measuring physical attributes 


GRADE 4 


GRADES 


GRADE 12 


a) Identify the attribute that is 

appropriate to measure in a given 
situation. 






b) Compare objects with respect to a 
given attribute, such as length, 
area, volume, time, or 
temperature. 


b) Compare objects with respect to 
length, area, volume, angle 
measurement, weight, or mass. 




c) Estimate the size of an object with 
respect to a given measurement 
attribute (e.g., length, perimeter, 
or area using a grid). 


c) Estimate the size of an object with 
respect to a given measurement 
attribute (e.g., area). 


c) Estimate or compare perimeters or 
areas of two-dimensional 
geometric figures. 






d) Estimate or compare volume or 
surface area of three-dimensional 
figures. 






e) Solve problems involving the 
coordinate plane such as the 
distance between two points, the 
midpoint of a segment, or slopes 
of perpendicular or parallel lines. 






f) Solve problems of angle measure, 
including those involving triangles 
or other polygons or parallel lines 
cut by a transversal. 


g) Select or use appropriate 

measurement instruments such as 
ruler, meter stick, clock, 
thermometer, or other scaled 
instruments. 


g) Select or use appropriate 
measurement instrument to 
determine or create a given length, 
area, volume, angle, weight, or 
mass. 




h) Solve problems involving 
perimeter of plane figures. 


h) Solve mathematical or real-world 
problems involving perimeter or 
area of plane figures such as or 
composite figures. 


h) Solve mathematical or real-world 
problems involving perimeter or 
area of plane figures such as 
polygons, circles, or composite 
figures. 


i) Solve problems involving area of 
squares and rectangles. 








j) Solve problems involving volume 
or surface area of rectangular 
solids, cylinders, prisms, or 
composite shapes. 


j) Solve problems involving volume 
or surface area of rectangular 
solids, cylinders, cones, pyramids, 
prisms, spheres, or composite 
shapes. 



continued on page 19 
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Measurement (continued) 



1) Measuring physical attributes (continued) 


GRADE 4 


GRADE 8 


GRADE 12 




k) Solve problems involving indirect 
measurement such as finding the 
height of a building by comparing 
its shadow with the height and 
shadow of a known object. 


k) Solve problems involving indirect 
measurement such as finding the 
height of a building by finding the 
distance to the base of the 
building and the angle of elevation 
to the top. 




1) Solve problems involving rates 
such as speed or population 
density. 


1) Solve problems involving rates 
such as speed, density, population 
density, or flow rates. 






m) Use trigonometric relations in 
right triangles to solve problems. 


2) System of measurement 


GRADE 4 


GRADES 


GRADE 12 


a) Select or use appropriate type of 
unit for the attribute being 
measured such as length, time, or 
temperature. 


a) Select or use appropriate type of 
unit for the attribute being 
measured such as length, area, 
angle, time, or volume. 


a) Select or use appropriate type of 
unit for the attribute being 
measured such as volume or 
surface area. 


b) Solve problems involving 
conversions within the same 
measurement system such as 
conversions involving inches and 
feet or hours and minutes. 


b) Solve problems involving 
conversions within the same 
measurement system such as 
conversions involving square 
inches and square feet. 


b) Solve problems involving 
conversions within or between 
measurement systems, given the 
relationship between the units. 




c) Estimate the measure of an object 
in one system given the measure 
of that object in another system 
and the approximate conversion 
factor. For example: 

• Distance conversion: 1 
kilometer is approximately % 
of a mile. 

• Money conversion: U.S. dollar 
is approximately 1 .5 Canadian 
dollars. 

• Temperature conversion: 
Fahrenheit to Celsius 




d) Determine appropriate size of unit 
of measurement in problem 
situation involving such attributes 
as length, time, capacity, or 
weight. 


d) Determine appropriate size of unit 
of measurement in problem 
situation involving such attributes 
as length, area, or volume. 





continued on page 20 
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2) Systems of measurement (continued) 


GRADE 4 


GRADES 


GRADE 12 


e) Determine situations in which a 
highly accurate measurement is 
important. 


e) Determine appropriate accuracy of 
measurement in problem sit- 
uations (e.g., the accuracy of each 
of several lengths needed to obtain 
a specified accuracy of a total 
length) and find the measure to 
that degree of accuracy. 


e) Determine appropriate accuracy of 
measurement in problem 
situations (e.g., the accuracy of 
measurement of the dimensions to 
obtain a specified accuracy of 
area) and find the measure to that 
degree of accuracy. 




f) Construct or solve problems (e.g., 
floor area of a room) involving 
scale drawings. 


f) Construct or solve problems (e.g., 
number of rolls needed for 
insulating a house) involving scale 
drawings. 






g) Compare lengths, areas, or 
volumes of similar figures using 
proportions. 



Geometry 

Geometry began as a praetieal colleetion of rules for calculating lengths, areas, and 
volumes of common shapes. In classical times, the Greeks turned it into a subject for 
reasoning and proof, and Euclid organized their discoveries into a coherent collection of 
results, all deduced using logic from a small number of special assumptions called 
postulates. Euclid’s Elements stood as a pinnacle of human intellectual achievement for 
over 2000 years. 

The 19th century saw a new flowering of geometric thought, going beyond Euclid, 
and leading to the idea that geometry is the study of the possible structures of space. 

This had its most striking application in Einstein’s theories of relativity, which describes 
the behavior of light, and also of gravity, in terms of a four-dimensional geometry, 
which combines the usual three dimensions of space with time as an additional 
dimension. 

A major insight of the 19th century is that geometry is intimately related to ideas of 
symmetry and transformation. The symmetry of familiar shapes under simple 
transformations (that our bodies look more or less the same if reflected across the 
middle, or that a square looks the same if rotated by 90 degrees) is a matter of everyday 
experience. Many of the standard terms for triangles (scalene, isosceles, equilateral) and 
quadrilaterals (parallelogram, rectangle, rhombus, square) refer to symmetry properties. 
Also, the behavior of figures under changes of scale is an aspect of symmetry with 
myriad practical consequences. At a deeper level, the fundamental ideas of geometry 
itself (for example, congruence) depend on transformation and invariance. In the 20th 
century, symmetry ideas were seen to also underlie much of physics, not only Einstein’s 
relativity theories, but atomic physics and solid-state physics (the field that produced 
computer chips). 
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School geometry roughly mirrors the historical development through Greek times 
with some modern additions, most notably symmetry and transformations. By grade 4, 
students are expected to be familiar with a library of simple figures and their attributes, 
both in the plane (lines, circles, triangles, reetangles, and squares) and in space (cubes, 
spheres, and cylinders). In middle sehool, understanding of these shapes deepens, with 
the study of cross-seetions of solids and the beginnings of an analytical understanding of 
properties of plane figures, espeeially parallelism, perpendicularity, and angle relations 
in polygons. Right angles and the Pythagorean theorem are introduced, and geometry 
becomes more and more mixed with measurement. The basis for analytic geometry is 
laid by study of the number line. In high school, attention is given to Euclid’s legacy 
and the power of rigorous thinking. Students are expeeted to make, test, and validate 
conjectures. Via analytie geometry, the key areas of geometry and algebra are merged 
into a powerful tool that provides a basis for calculus and the applications of 
mathematics that helped create the modern teehnological world in whieh we live. 

Symmetry is an increasingly important component of geometry. Elementary students 
are expected to be familiar with the basie types of symmetry transformations of plane 
figures, including flips (reflection across lines), turns (rotations around points), and 
slides (translations). In middle school, this knowledge becomes more systematic and 
analytical, with each type of transformation being distinguished from other types by 
their qualitative effects. Eor example, a rigid motion of the plane that leaves at least two 
points fixed (but not all points) must be a refleetion in a line. In high sehool, students 
are expected to be able to represent transformations algebraieally. Some may also gain 
insight into systematic structure, sueh as the classifieation of rigid motions of the plane 
as refleetions, rotations, translations, or glide reflections, and what happens when two or 
more isometries are performed in suceession (eomposition). 
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Geometry 



1) Dimension and shape 


GRADE 4 


GRADE 8 


GRADE 12 


a) Explore properties of paths 
between points. 


a) Draw or describe a path of 

shortest length between points to 
solve problems in context. 




b) Identify or describe (informally) 
real-world objects using simple 
plane figures (e.g., triangles, 
rectangles, squares, and circles) 
and simple solid figures (e.g., 
cubes, spheres, and cylinders). 


b) Identify a geometric object given 
a written description of its 
properties. 


b) Use two-dimensional 
representations of three- 
dimensional objects to visualize 
and solve problems involving 
surface area and volume. 


c) Identify or draw angles and other 
geometric figures in the plane. 


c) Identify, define, or describe 
geometric shapes in the plane and 
in three-dimensional space given a 
visual representation. 


c) Give precise mathematical 
descriptions or definitions of 
geometric shapes in the plane and 
in three-dimensional space. 




d) Draw or sketch from a written 
description polygons, circles, or 
semicircles. 


d) Draw or sketch from a written 
description plane figures (e.g., 
isosceles triangles, regular 
polygons, curved figures) and 
planar images of three- 
dimensional figures (e.g., 
polyhedra, spheres, and 
hemispheres). 




e) Represent or describe a three- 
dimensional situation in a two- 
dimensional drawing from 
different views. 


e) Describe or analyze properties of 
spheres and hemispheres. 


f) Describe attributes of two- and 
three-dimensional shapes. 


f) Demonstrate an understanding 
about the two- and three- 
dimensional shapes in our world 
through identifying, drawing, 
modeling, building, or taking 
apart. 





continued on page 23 
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Geometry (continued) 



2) Transformation of shapes and preservation of properties 


GRADE 4 


GRADE 8 


GRADE 12 


a) Identify whether a figure is 
symmetrical, or draw lines of 
symmetry. 


a) Identify lines of symmetry in 
plane figures or recognize and 
classify types of symmetries of 
plane figures. 


a) Recognize or identify types of 
symmetries (e.g., point, line, 
rotational, self-congruences) of 
two- and three-dimensional 
figures. 






b) Give or recognize the precise 
mathematical relationship (e.g., 
congruence, similarity, 
orientation) between a figure and 
its image under a transformation. 


c) Identify the images resulting from 
flips (reflections), slides 
(translations), or turns (rotations). 


c) Recognize or informally describe 
the effect of a transformation on 
two-dimensional geometric shapes 
(reflections across lines of 
symmetry, rotations, translations, 
magnifications, and contractions). 


c) Perform or describe the effect of a 
single transformation on two- and 
three-dimensional geometric 
shapes (reflections across lines of 
symmetry, rotations, translations, 
and dilations). 


d) Recognize which attributes (such 
as shape and area) change or don’t 
change when plane figures are cut 
up or rearranged. 


d) Predict results of combining, 
subdividing, and changing shapes 
of plane figures and solids (e.g., 
paper folding, tiling, and cutting 
up and rearranging pieces). 


d) Describe the final outcome of 
successive transformations. 


e) Match or draw congruent figures 
in a given collection. 


e) Justify relationships of 

congruence and similarity, and 
apply these relationships using 
scaling and proportional 
reasoning. 


e) Justify relationships of 

congruence and similarity, and 
apply these relationships using 
scaling and proportional 
reasoning. 




f) For similar figures, identify and 
use the relationships of 
conservation of angle and of 
proportionality of side length and 
perimeter. 





continued on page 24 
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Geometry (continued) 



3) Relationships between geometric fignres 


GRADE 4 


GRADE 8 


GRADE 12 


a) Analyze or describe patterns of 
geometric figures by increasing 
number of sides, changing size or 
orientation (e.g., polygons with 
more and more sides). 






b) Assemble simple plane shapes to 
construct a given shape. 


b) Apply geometric properties and 
relationships in solving simple 
problems in two and three 
dimensions. 


b) Apply geometric properties and 
relationships in solving multi-step 
problems in two and three 
dimensions (including rigid and 
non-rigid figures). 


c) Recognize two-dimensional faces 
of three-dimensional shapes. 


c) Represent problem situations with 
simple geometric models to solve 
mathematical or real-world 
problems. 


c) Represent problem situations with 
geometric models to solve 
mathematical or real-world 
problems. 




d) Use the Pythagorean theorem to 
solve problems. 


d) Use the Pythagorean theorem to 
solve problems in two- or three- 
dimensional situations. 






e) Describe and analyze properties of 
circles (e.g., perpendicularity of 
tangent and radius, angle inscribed 
in a semicircle). 


f) Describe and compare properties 
of simple and compound figures 
composed of triangles, squares, 
and rectangles. 


f) Describe or analyze simple 
properties of, or relationships 
between, triangles, quadrilaterals, 
and other polygonal plane figures. 


f) Analyze properties or 
relationships of triangles, 
quadrilaterals, and other 
polygonal plane figures. 




g) Describe or analyze properties and 
relationships of parallel or 
intersecting lines. 


g) Describe or analyze properties and 
relationships of parallel, 
perpendicular, or intersecting 
lines, including the angle 
relationships that arise in these 
cases. 



continued on page 25 
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Geometry (continued) 



4) Position and direction 


GRADE 4 


GRADE 8 


GRADE 12 


a) Describe relative positions of 
points and lines using the 
geometric ideas of parallelism or 
perpendicularity. 


a) Describe relative positions of 
points and lines using the 
geometric ideas of midpoint, 
points on common line through a 
common point, parallelism, or 
perpendicularity. 






b) Describe the intersection of two or 
more geometric figures in the 
plane (e.g., intersection of a circle 
and a line). 


h) Describe the intersection of two or 
more geometric figures in the 
plane (e.g., intersection of a circle 
and a line). 




c) Visualize or describe the cross 
section of a solid. 


c) Visualize or describe the cross 
section of a solid. 


d) Construct geometric figures with 
vertices at points on a coordinate 
grid. 


d) Represent geometric figures using 
rectangular coordinates on a 
plane. 


d) Represent geometric figures using 
rectangular coordinates on a 
plane. 






e) Use vectors to represent velocity 
and direction. 


5) Mathematical reasoning 


GRADE 4 


GRADE 8 


GRADE 12 


a) Distinguish which objects in a 
collection satisfy a given 
geometric definition and explain 
choices. 


a) Make and test a geometric 

conjecture about regular polygons. 


a) Make, test, and validate geometric 
conjectures using a variety of 
methods including deductive 
reasoning and counterexamples. 



Data Analysis and Probability 

Data analysis covers the entire proeess of eollecting, organizing, summarizing, and 
interpreting data. This is the heart of the diseipline ealled statisties; it is in evidenee 
whenever quantitative information is used to determine a eourse of aetion. To 
emphasize the spirit of statistieal thinking, data analysis should begin with a question to 
be answered, not with the data. Data should be eollected only with a specifie question 
(or questions) in mind and only after a plan (usually ealled a design) for oolleeting data 
relevant to the question is thought out. Beginning at an early age, students should grasp 
the fundamental prineiple that looking for questions in an existing data set is far 
different from the seientifie method of eollecting data to verify or refute a well-posed 
question. A pattern ean be found in almost any data set if one looks hard enough, but a 
pattern discovered in this way is often meaningless, espeeially from the point of view of 
statistical inference. 
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In the context of data analysis, or statistics, probability can be thought of as the study 
of potential patterns in outcomes that have not yet been observed. We say that the 
probability of a balanced coin coming up heads when flipped is one-half because we 
believe that about half of the flips would turn out to be heads if we flipped the coin 
many times. Under random sampling, patterns for outcomes of designed studies can be 
anticipated and used as the basis for making decisions. If the coin actually turned up 
heads 80 percent of the time, we would suspect that it was not balanced. The whole 
probability distribution of all possible outcomes is important in most statistics problems 
because the key to decisionmaking is to decide whether a particular observed outcome is 
unusual (located in a tail of the probability distribution). For example, 4 as a grade point 
average is unusually high among most groups of students, 4 as the pound weight of a 
baby is unusually low, and 4 as the number of runs scored in a baseball game is not 
unusual in either direction. 

By grade 4, students should be expected to apply their understanding of number and 
quantity to pose questions that can be answered by collecting appropriate data. They 
should be expected to organize data in a table or a plot and summarize the essential 
features of center, spread, and shape both verbally and with simple summary statistics. 
Simple comparisons can be made between two related data sets, but more formal 
inference based on randomness should come later. The basic concept of chance and 
statistical reasoning can be built into meaningful contexts, though, such as, “If I draw 
two names from among those of the students in the room, am I likely to get two girls?” 
Such problems can be addressed through simulation. 

Building on the same definition of data analysis and the same principles of describing 
distributions of data through center, spread, and shape, grade 8 students will be expected 
to use a wider variety of organizing and summarizing techniques. They can also begin to 
analyze statistical claims through designed surveys and experiments that involve 
randomization, with simulation being the main tool for making simple statistical 
inferences. They will begin to use more formal terminology related to probability and 
data analysis. 

Students in grade 12 will be expected to use a wide variety of statistical techniques 
for all phases of the data analysis process, including a more formal understanding of 
statistical inference (but still with simulation as the main inferential analysis tool). In 
addition to comparing univariate data sets, students at this level should be able to 
recognize and describe possible associations between two variables by looking at two- 
way tables for categorical variables or scatter plots for measurement variables. 
Association between variables is related to the concepts of independence and 
dependence, and an understanding of these ideas requires knowledge of conditional 
probability. These students should be able to use statistical models (linear and non- 
linear equations) to describe possible associations between measurement variables and 
should be familiar with techniques for fitting models to data. 
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Data Analysis and Probability 



1) Data representation 


GRADE 4 


GRADE 8 


GRADE 12 


The following representations of data are indicated for each grade level. Objectives in which only a subset of these 
representations is applicable are indicated in the parenthesis associated with the objective. 


Pictographs, bar graphs, circle 
graphs, line graphs, line plots, tables, 
and tallies. 


Flistograms, line graphs, scatter plots, 
box plots, circle graphs, stem and leaf 
plots, frequency distributions, tables, 
and bar graphs. 


Histograms, line graphs, scatter plots, 
box plots, circle graphs, stem and leaf 
plots, frequency distributions, and 
tables. 


a) Read or interpret a single set of 
data. 


a) Read or interpret data, including 
interpolating or extrapolating from 
data. 


a) Read or interpret data, including 
interpolating or extrapolating from 
data. 


b) For a given set of data, complete a 
graph (limits of time make it 
difficult to construct graphs 
completely). 


b) For a given set of data, complete a 
graph and then solve a problem 
using the data in the graph 
(histograms, line graphs, scatter 
plots, circle graphs, and bar 
graphs). 


b) For a given set of data, complete a 
graph and then solve a problem 
using the data in the graph 
(histograms, scatter plots, line 
graphs). 


c) Solve problems by estimating and 
computing within a single set of 
data. 


c) Solve problems by estimating and 
computing with data from a single 
set or across sets of data. 


c) Solve problems by estimating and 
computing with univariate or 
bivariate data (including scatter 
plots and two-way tables). 




d) Given a graph or a set of data, 
determine whether information is 
represented effectively and 
appropriately (histograms, line 
graphs, scatter plots, circle graphs, 
and bar graphs). 


d) Given a graph or a set of data, 
determine whether information is 
represented effectively and 
appropriately (bar graphs, box 
plots, histograms, scatter plots, 
line graphs). 




e) Compare and contrast the 
effectiveness of different 
representations of the same data. 


e) Compare and contrast the 
effectiveness of different 
representations of the same data. 



continued on page 28 
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Data Analysis and Probability (continued) 



2) Characteristics of data sets 


GRADE 4 


GRADE 8 


GRADE 12 




a) Calculate, use, or interpret mean, 
median, mode, or range. 


a) Calculate, interpret, or use mean, 
median, mode, range, interquartile 
range, or standard deviation. 


b) Given a set of data or a graph, 
describe the distribution of the 
data using median, range, or 
mode. 


b) Describe how mean, median, 
mode, range, or interquartile 
ranges relate to the shape of the 
distribution. 


h) Recognize how linear transfor- 
mations of one-variable data affect 
mean, median, mode, and range 
(e.g., effect on the mean by adding 
a constant to each data point). 




c) Identify outliers and determine 
their effect on mean, median, 
mode, or range. 


c) Determine the effect of outliers on 
mean, median, mode, range, 
interquartile range, or standard 
deviation. 


d) Compare two sets of related data. 


d) Using appropriate statistical 
measures, compare two or more 
data sets describing the same 
characteristic for two different 
populations or subsets of the same 
population. 


d) Compare two or more data sets 
using mean, median, mode, range, 
interquartile range, or standard 
deviation describing the same 
characteristic for two different 
populations or subsets of the same 
population. 




e) Visually choose the line that best 
fits given a scatter plot and 
informally explain the meaning of 
the line. Use the line to make 
predictions. 


e) Given a set of data or a scatter 
plot, visually choose the line of 
best fit and explain the meaning of 
the line. Use the line to make 
predictions. 






f) Use or interpret a normal distri- 
bution as a mathematical model 
appropriate for summarizing 
certain sets of data. 






g) Given a scatter plot, make 

decisions or predictions involving 
a line or curve of best fit. 






h) Given a scatter plot, estimate the 
correlation coefficient (e.g.. Given 
a scatter plot, is the correlation 
closer to 0, .5, or 1 .0? Is it a 
positive or negative correlation?). 



continued on page 29 
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Data Analysis and Probability (continued) 



3) Experiments and samples 


GRADE 4 


GRADE 8 


GRADE 12 




a) Given a sample, identify possible 
sources of bias in sampling. 


a) Identify possible sources of bias in 
data collection methods and 
describe how such bias can be 
controlled and reduced. 




b) Distinguish between a random and 
non-random sample. 


b) Recognize and describe a method 
to select a simple random sample. 




d) Evaluate the design of an 
experiment. 


c) Make inferences from sample 
results. 






d) Identify or evaluate the charac- 
teristics of a good survey or of a 
well-designed experiment. 


4) Probability 


GRADE 4 


GRADES 


GRADE 12 


a) Use informal probabilistic 

thinking to describe chance events 
(i.e., likely and unlikely, certain 
and impossible). 


a) Analyze a situation that involves 
probability of an independent 
event. 


a) Analyze a situation that involves 
probability of independent or 
dependent events. 


b) Determine a simple probability 
from a context that includes a 
picture. 


b) Determine the theoretical 
probability of simple and 
compound events in familiar 
contexts. 


b) Determine the theoretical 
probability of simple and 
compound events in familiar or 
unfamiliar contexts. 




c) Estimate the probability of simple 
and compound events through 
experimentation or simulation. 


c) Given the results of an experiment 
or simulation, estimate the 
probability of simple or 
compound events in familiar or 
unfamiliar contexts. 




d) Use theoretical probability to 
evaluate or predict experimental 
outcomes. 


d) Use theoretical probability to 
evaluate or predict experimental 
outcomes. 


e) List all possible outcomes of a 
given situation or event. 


e) Determine the sample space for a 
given situation. 


e) Determine the number of ways an 
event can occur using tree 
diagrams, formulas for 
combinations and permutations, or 
other counting techniques. 




f) Use a sample space to determine 
the probability of the possible 
outcomes of an event. 


f) Determine the probability of the 
possible outcomes of an event. 


g) Represent the probability of a 
given outcome using a picture or 
other graphic. 


g) Represent probability of a given 
outcome using fractions, decimals, 
and percents. 





continued on page 30 
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Data Analysis and Probability (continued) 



4) Probability (continued) 


GRADE 4 


GRADE 8 


GRADE 12 




h) Determine the probability of 
independent and dependent 
events. (Dependent events should 
be limited to linear functions with 
a small sample size.) 


h) Determine the probability of 
independent and dependent 
events. 






i) Determine conditional probability 
using two-way tables. 




j) Interpret probabilities within a 
given context. 


j) Interpret probabilities within a 
given context. 



Algebra 

Algebra was pioneered in the Middle Ages by mathematieians in the Middle East and 
Asia as a method of solving equations easily and effieiently by manipulation of 
symbols, rather than by the earlier geometrie methods of the Greeks. The two 
approaches were eventually united in the analytic geometry of Rene Descartes. Modern 
symbolic notation, developed in the Renaissance, greatly enhanced the power of the 
algebraic method; from the 17th century forward, algebra in turn promoted advances in 
all branches of mathematics and science. 

The widening use of algebra led to the study of its formal structure. Out of this were 
gradually distilled the “rules of algebra,” a compact summary of the principles behind 
algebraic manipulation. A parallel line of thought produced a simple but flexible 
concept of function and also led to the development of set theory as a comprehensive 
background for mathematics. When it is taken liberally to include these ideas, algebra 
reaches from the foundations of mathematics to the frontiers of current research. 

These two aspects of algebra, a powerful representational tool and a vehicle for 
comprehensive concepts such as function, form the basis for the expectations throughout 
the grades. By grade 4, students are expected to be able to recognize and extend simple 
numeric patterns as one foundation for a later understanding of function. They can begin 
to understand the meaning of equality and some of its properties, as well as the idea of 
an unknown quantity as a precursor to the concept of variable. 

As students move into middle school, the ideas of function and variable become more 
important. Representation of functions as patterns, via tables, verbal descriptions, 
symbolic descriptions, and graphs, can combine to promote a flexible grasp of the idea 
of function. Linear functions receive special attention. They connect to the ideas of 
proportionality and rate, forming a bridge that will eventually link arithmetic to 
calculus. Symbolic manipulation in the relatively simple context of linear equations is 
reinforced by other means of finding solutions, including graphing by hand or with 
calculators. 
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In high school, students should become comfortable in manipulating and interpreting 
more complex expressions. The rules of algebra should come to be appreciated as a 
basis for reasoning. Non-linear functions, especially quadratic functions, and also power 
and exponential functions, are introduced to solve real-world problems. Students should 
become accomplished at translating verbal descriptions of problem situations into 
symbolic form. Expressions involving several variables, systems of linear equations, 
and the solutions to inequalities are encountered by grade 12. 

Algebra 



1) Patterns, relations, and fnnctions 


GRADE 4 


GRADE 8 


GRADE 12 


a) Recognize, describe, or extend 
numerical patterns. 


a) Recognize, describe, or extend 
numerical and geometric patterns 
using tables, graphs, words, or 
symbols. 


a) Recognize, describe, or extend 
arithmetic, geometric 
progressions, or patterns using 
words or symbols. 


b) Given a pattern or sequence, 

construct or explain a rule that can 
generate the terms of the pattern 
or sequence. 


h) Generalize a pattern appearing in 
a numerical sequence or table or 
graph using words or symbols. 


h) Express the function in general 
terms (either recursively or 
explicitly), given a table, verbal 
description, or some terms of a 
sequence. 


c) Given a description, extend or 
find a missing term in a pattern or 
sequence. 


c) Analyze or create patterns, 
sequences, or linear functions 
given a rule. 




d) Create a different representation 
of a pattern or sequence given a 
verbal description. 






e) Recognize or describe a 

relationship in which quantities 
change proportionally. 


e) Identify functions as linear or non- 
linear or contrast distinguishing 
properties of functions from 
tables, graphs, or equations. 


e) Identify or analyze distinguishing 
properties of linear, quadratic, 
inverse (y = k/x) or exponential 
functions from tables, graphs, or 
equations. 




f) Interpret the meaning of slope or 
intercepts in linear functions. 








g) Determine the domain and range 
of functions given various 
contexts. 






h) Recognize and analyze the general 
forms of linear, quadratic, inverse, 
or exponential functions (e.g., iny 
= ax + b, recognize the roles of a 
andh). 






i) Express linear and exponential 
functions in recursive and explicit 
form given a table or verbal 
description. 



continued on page 32 
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Algebra (continued) 



2) Algebraic representations 


GRADE 4 


GRADE 8 


GRADE 12 


a) Translate between the different 
forms of representations (sym- 
bolic, numerical, verbal, or 
pictorial) of whole number re- 
lationships (such as from a written 
description to an equation or from 
a function table to a written 
description). 


a) Translate between different rep- 
resentations of linear expressions 
using symbols, graphs, tables, 
diagrams, or written descriptions. 


a) Translate between different rep- 
resentations of algebraic 
expressions using symbols, 
graphs, tables, diagrams, or 
written descriptions. 




b) Analyze or interpret linear 
relationships expressed in 
symbols, graphs, tables, diagrams, 
or written descriptions. 


b) Analyze or interpret relationships 
expressed in symbols, graphs, 
tables, diagrams, or written 
descriptions. 


c) Graph or interpret points with 
whole number or letter 
coordinates on grids or in the first 
quadrant of the coordinate plane. 


c) Graph or interpret points that are 
represented by ordered pairs of 
numbers on a rectangular 
coordinate system. 


c) Graph or interpret points that are 
represented by one or more 
ordered pairs of numbers on a 
rectangular coordinate system. 




d) Solve problems involving coor- 
dinate pairs on the rectangular 
coordinate system. 


d) Perform or interpret 

transformations on the graphs of 
linear and quadratic functions. 


e) Verify a conclusion using 
algebraic properties. 


e) Make, validate, and justify 
conclusions and generalizations 
about linear relationships. 


e) Use algebraic properties to 
develop a valid mathematical 
argument. 






f) Use an algebraic model of a 
situation to make inferences or 
predictions. 




g) Identify or represent functional 
relationships in meaningful 
contexts including proportional, 
linear, and common non-linear 
(e.g., compound interest, bacterial 
growth) in tables, graphs, words, 
or symbols. 


g) Given a real-world situation, 
determine if a linear, quadratic, 
inverse, or exponential function 
fits the situation (e.g., half-life 
bacterial growth). 






h) Solve problems involving 
exponential growth and decay. 



continued on page 33 
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Algebra (continued) 



3) Variables, expressions, and operations 


GRADE 4 


GRADES 


GRADE 12 


a) Use letters and symbols to 
represent an unknown quantity 
in a simple mathematical 
expression. 






b) Express simple mathematical 
relationships using number 
sentences. 


b) Write algebraic expressions, 
equations, or inequalities to 
represent a situation. 


b) Write algebraic expressions, equations, 
or inequalities to represent a situation. 




c) Perform basic operations, 
using appropriate tools, on 
linear algebraic expressions 
(including grouping and order 
of multiple operations 
involving basic operations, 
exponents, roots, simplifying, 
and expanding). 


c) Perform basic operations, using 
appropriate tools, on algebraic 
expressions (including grouping and 
order of multiple operations involving 
basic operations, exponents, roots, 
simplifying, and expanding). 






d) Write equivalent forms of algebraic 
expressions, equations, or inequalities to 
represent and explain mathematical 
relationships. 



continued on page 34 
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Algebra (continued) 



4) Equations and inequalities 


GRADE 4 


GRADE 8 


GRADE 12 


a) Find the value of the unknown in 
a whole number sentence. 


a) Solve linear equations or 

inequalities (e.g., av + b = c or ax 
+ b = cx + d or ax + b > c). 


a) Solve linear, rational, or quadratic 
equations or inequalities. 




b) Interpret "=" as an equivalence be- 
tween two expressions and use 
this interpretation to solve 
problems. 






c) Analyze situations or solve 
problems using linear equations 
and inequalities with rational 
coefficients symbolically or 
graphically (e.g., ax + b = c or ax 
-l-b = cx + d). 


c) Analyze situations or solve 

problems using linear or quadratic 
equations or inequalities sym- 
bolically or graphically. 




d) Interpret relationships between 
symbolic linear expressions and 
graphs of lines by identifying and 
computing slope and intercepts 
(e.g., know iny = ax + b, that a is 
the rate of change and b is the 
vertical intercept of the graph). 


d) Recognize the relationship 

between the solution of a system 
of linear equations and its graph. 




e) Use and evaluate common 
formulas [e.g., relationship 
between a circle’s circumference 
and diameter (C = Ttd), distance 
and time under constant speed]. 


e) Solve problems involving more 
advanced formulas [e.g., the 
volumes and surface areas of three 
dimensional solids; or such 
formulas as: A = P(1 + r)‘, A = 
PeT. 






f) Given a familiar formula, solve 
for one of the variables. 






g) Solve or interpret systems of 
equations or inequalities. 
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Chapter Four: Mathematical Complexity 
of Items 



E ach NAEP item assesses an objective that can be associated with a single content 
area of mathematics, such as number or geometry. The item also makes certain 
demands on students’ thinking. These demands constitute the mathematieal 
complexity of the item, whieh is the second dimension of the mathematics framework. 
The demands on thinking that an item makes (what it asks the student to reeall, 
understand, reason about, and do) are determined on the assumption that the student is 
familiar with the mathematics of the task. If a student has not studied the mathematics, 
the task is likely to make different and heavier demands, and the student may well not 
be successful. Items are chosen for administration at a given grade level in part on the 
basis of their appropriateness for typieal eurrieula, but the complexity of those items is 
always independent of the particular curriculum a student has experieneed. 



The categories (low complexity, moderate complexity, and high complexity) form an 
ordered deseription of the demands an item may make on a student. Items at the low 
level of complexity, for example, may ask a student to recall a property. At the moderate 
level, an item may ask the student to make a connection between two properties; at the 
high level, an item may ask a student to analyze the assumptions made in a 
mathematical model. This is an example of the distinetions made in item complexity to 
provide balance in the item pool. The ordering is not intended to imply that mathematies 
is learned or should be taught in sueh an ordered way. 



The complexity dimension is both similar to and different from the levels of 
mathematical ability (conceptual understanding, proeedural knowledge, and problem 
solving) that were used in the NAEP Mathematics Eramework for the 1996 and 2000 
assessments. The dimensions are similar in that both attempt to address the kind of 
thinking that the student is doing when working on an item. They are also similar in that 
although neither dimension is used to define speeific percentages of items in each 
content area, both are used to help define item deseriptors and achieve a balance aeross 
the tasks administered at eaeh grade level. Eevel of eomplexity is different from level of 
mathematieal ability, however, in that eomplexity deseribes the mathematical 
expectations of an item, whereas mathematieal ability (along with the assoeiated 
construct of mathematical power) requires an inference about the skill, knowledge, and 
baekground of the students taking the item. 



The mathematieal complexity of an item is not directly related to its format (multiple 
choice, short constructed response, or extended construeted response). Items requiring 
that the student generate a response tend to make somewhat heavier demands on 
students than items requiring a ehoiee among alternatives, but that is not always the 
case. Any type of item can deal with mathematies of greater or lesser depth and 
sophistication. There are multiple-choice items that assess complex mathematies, and 
constructed-response items ean be erafted to assess routine mathematieal ideas. 
Moreover, the mathematical complexity of an item is constant; it does not vary 
depending on the score given for a certain kind or level of response. 
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Low Complexity 

This category relies heavily on the reeall and reeognition of previously learned 
eoneepts and prineiples. Items typieally speeify what the student is to do, whieh is often 
to earry out some proeedure that ean be performed meehanieally. It is not left to the 
student to eome up with an original method or solution. The following are some, but not 
all, of the demands that items in the low-complexity eategory might make: 

• Recall or recognize a faet, term, or property. 

• Recognize an example of a concept. 

• Compute a sum, differenee, produet, or quotient. 

• Reeognize an equivalent representation. 

• Perform a speeified proeedure. 

• Evaluate an expression in an equation or formula for a given variable. 

• Solve a one-step word problem. 

• Draw or measure simple geometrie figures. 

• Retrieve information from a graph, table, or figure. 

Examples 

See appendix B for solutions and scoring guides. 

• Reeall or reeognize a faet, term, or property. 

How many fourths make a whole? 

Answer: 

Source: 1996 NAEP (grade 4) Pereent eorreet: 50 

• Compute a sum, differenee, product, or quotient. 

+ 6 + -12 = 

A. -6 

B. +6 

C. -18 

D. +18 

Source: 1990 NAEP (grade 8) Pereent eorreet: 68 

• Provide or reeognize equivalent representations. 

N stands for the number of stamps John had. He gave 12 stamps to his sister. 

Which expression tells how many stamps John has now? 

A.N+ 12 
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B. N- 12 

C. 12-A^ 

D. 12 xA^ 

Source: 1996 NAEP (grade 4) Percent correct; 67 



• Perform a specified procedure. 

How many hours are equal to 150 minutes? 

A. H/2 

B. 2Va 

C. Th 

D. 21/2 

E. TU 



Source: 1990 NAEP (grade 12) Percent correct: 74 



• Retrieve information from a graph, table, or figure. 




What is the weight shown on the scale? 

A. 6 pounds 

B. 7 pounds 

C. 51 pounds 

D. 60 pounds 

Source: 1992 NAEP (grade 4) Percent correct; 44 



Moderate Complexity 

Items in the moderate-complexity category involve more flexibility of thinking and 
choice among alternatives than do those in the low-complexity category. They require a 
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response that goes beyond the habitual, is not speeified, and ordinarily has more than a 
single step. The student is expeeted to deeide what to do, using informal methods of 
reasoning and problem-solving strategies, and to bring together skill and knowledge 
from various domains. The following illustrate some of the demands that items of 
moderate eomplexity might make: 

• Represent a situation mathematically in more than one way. 

• Select and use different representations, depending on situation and purpose. 

• Solve a word problem requiring multiple steps. 

• Compare figures or statements. 

• Provide a justification for steps in a solution process. 

• Interpret a visual representation. 

• Extend a pattern. 

• Retrieve information from a graph, table, or figure and use it to solve a problem 
requiring multiple steps. 

• Formulate a routine problem, given data and conditions. 

• Interpret a simple argument. 

Examples 

See appendix B for solutions and scoring guides. 

The following shapes were provided to students. (Shapes were larger than shown.) 



N 



(Grade 8 version) 

Bob, Carmen, and Tyler were comparing the areas of N and P. Bob said that N and 
P have the same area. Carmen said that the area of N is larger. Tyler said that the 
area of P is larger. 

Who was correct? 

Use words or pictures (or both) to explain why. 

Source: 1996 NAEP (grades 4 and 8) Percent correct: 27 
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• Interpret a visual representation. 




In this figure, how many small cubes were put together to form the large cube? 

A. 7 

B. 8 

C. 12 

D. 24 



Source: 1996 NAEP (grade 4) Percent correct: 33 



• Extend a pattern. 

Erom any vertex of a 4-sided polygon, 1 diagonal can be drawn. 

Erom any vertex of a 5 -sided polygon, 2 diagonals can be drawn. 

Erom any vertex of a 6-sided polygon, 3 diagonals can be drawn. 

Erom any vertex of a 7-sided polygon, 4 diagonals can be drawn. 

How many diagonals can be drawn from any vertex of a 20-sided polygon? 

Answer: 

Source: 1996 NAEP (grade 8) Percent correct: 54 



• Interpret a simple argument. 

Tracy said, “I can multiply 6 by another number and get an answer that is smaller 
than 6.” 

Pat said, “No, you can’t. Multiplying 6 by another number always makes the 
answer 6 or larger.” 

Who is correct? Give a reason for your answer. 

Source: 1992 NAEP (grades 8 and 12) Percent correct: 49 (grade 8); 63 (grade 12) 
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High Complexity 

High-complexity items make heavy demands on students, who must engage in more 
abstraet reasoning, planning, analysis, judgment, and ereative thought. A satisfaetory 
response to the item requires that the student think in abstraet and sophistieated ways. 
Items at the level of high complexity may ask the student to do any of the following; 

• Deseribe how different representations ean be used for different purposes. 

• Perform a proeedure having multiple steps and multiple deeision points. 

• Analyze similarities and differenees between proeedures and eoneepts. 

• Generalize a pattern. 

• Formulate an original problem, given a situation. 

• Solve a novel problem. 

• Solve a problem in more than one way. 

• Explain and justify a solution to a problem. 

• Deseribe, eompare, and eontrast solution methods. 

• Formulate a mathematieal model for a complex situation. 

• Analyze the assumptions made in a mathematieal model. 

• Analyze or produce a deductive argument. 

• Provide a mathematieal justifieation. 

Examples 

See appendix B for solutions and scoring guides. 

• Generalize a pattern. 

A pattern of dots is shown below. At eaeh step, more dots are added to the 
pattern. The number of dots added at eaeh step is more than the number added in 
the previous step. The pattern eontinues infinitely. 



(l.st .step) 



2 Dots 



(2nd .step) 

• • • 
• • • 

6 Dots 



(3rd step) 

• • • • 
• • • • 
• • • • 

12 Dots 



Marcy has to determine the number of dots in the 20th step, but she does not 
want to draw all 20 pietures and then eount the dots. Explain or show how she 
could do this and give the answer that Marcy should get for the number of dots. 



Source: 1992 NAEP (grade 8) Pereent eorreet: 6 
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• Analyze or produce a deductive argument. 

Jaime knows the following facts about points A, B, and C. 

• Points A, B, and C are on the same line, but might not be in that order. 

• Point C is twice as far from point A as it is from point B. 

Jaime concluded that point C is always between points A and B. 

Is Jaime’s conclusion correct? 

C3 Yes CZ) No 

In the space provided, use a diagram to explain your answer. 

Source: 1996 NAEP (grade 8) Percent correct: 23 

• Provide a mathematical justification 




In Mr. Bell’s classes, the students voted for their favorite shape for a symbol. 
Here are the results. 





Class 1 


Class 2 


Class 3 


Shape N 


9 


14 


11 


Shape P 


1 


9 


17 


Shape Q 


22 


7 


CNI 



Using the information in the chart, Mr. Bell must select one of the shapes to be 
the symbol. Which one should he select and why? 

The shape Mr. Bell should select: 

Explain. 

Source: 1996 NAEP (grades 4 and 8) Percent correct: 31 (grade 4); 58 (grade 8) 
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Balance of Mathematical Complexity 

The ideal balanee sought for NAEP is not neeessarily the balanee one would wish for 
eurrieulum or instruetion in mathematies edueation. Balanee here must be eonsidered in 
the eontext of the eonstraints of an assessment sueh as NAEP. These eonstraints inelude 
the timed nature of the test and its paper-and-peneil format. Items of high eomplexity, 
for example, often take more time to eomplete. At the same time, some items of all three 
types are essential to assess the full range of students’ mathematieal aehievement. 

Within that eontext, the ideal balanee would be that half of the seore on the assessment 
is based on items of moderate eomplexity, with the remainder of the seore based equally 
on items of low and high eomplexity. 
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Chapter Five: Item Formats 



C entral to the development of the NAEP assessment in mathematies is the eareful 
selection of items/tasks. Since the 1992 assessment, items have consisted of 
three formats: multiple choice, short constructed response, and extended 
constructed response. Testing time on NAEP is divided evenly between multiple-choice 
items and both types of constructed-response items, as shown below: 




Multiple-Choice Items 

Multiple-choice items require students to read, reflect, or compute, and then to select 
the alternative that best expresses what they believe the answer to be. This format is 
appropriate for quickly determining whether students have achieved certain knowledge 
and skills. A carefully constructed multiple-choice item can assess any of the levels of 
mathematical complexity (described in chapter four), from simple procedures to more 
sophisticated concepts. Such items are limited in the extent to which they can provide 
evidence of the depth of students’ thinking. 

Example 

A 

80 • 

70 • • * 

Number 60 * 

50 * • 

Sit-ups • 

40 • • • 

30 * * 

‘ ^ 

10 15 20 25 30 

Age in Years 

In the graph above, each dot shows the number of sit-ups and the corresponding age for 
1 of 13 people. According to this graph, what is the median number of sit-ups for these 
13 people? 
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A. 15 

B. 20 

C. 45 

D. 50 

E. 55 



This item assesses students’ understanding of two eoneepts: median, and how data are 
displayed on a graph. For students who are able to eombine these eoneepts, little or no 
eomputation is required to determine the eorreet answer (D). 

Short Constructed-Response Items 

To provide more reliable and valid opportunities for extrapolating about students’ 
approaches to problems, NAEP assessments have included items that are often referred 
to as short constructed-response items. These are short-answer items that require 
students to give either a numerical result or the correct name or classification for a 
group of mathematical objects, draw an example of a given concept, or perhaps write a 
brief explanation for a given result. 

Example 

Product 

2x2 =4 

2x2x2 =8 

2x2x2x2 =16 

2x2x2x2x2 =32 

If the pattern shown continues, could 375 be one of the products in this pattern? 

Explain why or why not. 
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Scoring Guide 

Score and Description 

1 - Correct 

Correct reason; 

“Because 375 is not divisible by 2 (or is not even)” 

OR 

“Because 375 is between two of the numbers in the pattern.” 
Acceptable: “Because 375 is uneven.” 

Not acceptable: 

“Because you’re counting by 2s.” 

OR 

“Because you’re multiplying by 2.” 

0 - Incorrect 

Any incorrect or incomplete reason. 



This item assesses students’ understanding of number patterns and of odd and even 
numbers. Students are given the opportunity to explain why 375 could not be one of the 
products in the pattern. Scoring for this item was done on a correct/incorrect basis. Items 
such as this are valuable in providing greater evidence of the depth of students’ 
understanding than might be accomplished in other formats. Scoring for some short 
constructed-response items uses more than two points in the scale to award partial credit 
for work that is partially correct. Full credit is reserved for work that is mathematically 
correct and complete. 

Extended Constructed-Response Items 

Extended constructed-response items require students to consider a situation that 
demands more than a numerical response or a short verbal communication. If it is a 
problem to solve, the student is asked to carefully consider a situation within or across 
content areas, understand what is required to “solve” the situation, choose a plan of 
attack, carry out the attack, and interpret the solution derived in terms of the original 
situation. In the example that follows, the student is asked to analyze a situation and 
provide a mathematical explanation. 
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Example 

In a game, Carla and Maria are making subtraction problems using tiles numbered 1 to 
5. The player whose subtraction problem gives the largest answer wins the game. 



Look at where each girl placed two of her tiles. 

Carla 



1 




1 




5 


J 




Maria 







i 

5 




_ J 


1 

L 




Explain how you know this person will win. 



In this item, students are given the opportunity to display their understanding of place 
value and subtraction. They must examine the numbers left on each player’s tiles, 
consider all the possible placements of those tiles in the remaining spaces, then compare 
the results of the subtraction and construct an explanation of the situation. 

Scoring Extended Constructed-Response Items 

Extended constructed-response items in mathematics should be evaluated according 
to an established grading scale developed from a sample of actual student responses. 

The scale used should follow a multiple-point format similar to the following (this is the 
scoring guide for the previous example item): 
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Scoring Guide 

Solution: 

Maria will win the game. 

The following reasons may be given: 

a. The largest possible differenee for Carla is less than 100 and the smallest 
possible differenee for Maria is 194. 

b. Carla will only get a differenee of 91 or less but Maria will get several larger 
differenees. 

e. Carla ean have only up to 143 as her top number, but Maria ean have 435 as 
her largest number. 

d. Carla has only 1 hundred but Maria ean have 2, 3, or 4 hundreds. 

e. Maria can never take away as much as Carla. 

f Any combination of problems to show that Maria’s difference is greater. 



Carla 



Maria 
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Score and Description 
4 - Extended 

Student answers Maria and gives explanation such as (a) or (b), or an appropriate 
combination of the other explanations. 

3 - Satisfactory 

Student answers Maria and gives explanation such as (c), (d), or (e). 

2 - Partial 

Student answers Maria with partially correct, or incomplete but relevant, explanation. 

1 - Minimal 

Student answers Maria and gives example such as in (f) but no explanation OR answers 
Maria with an incorrect explanation. 

0 - Incorrect 

Incorrect response 



A scoring scale adapted to a particular problem and applied by experienced scorers 
provides rich information about students’ understanding of concepts and procedures, 
and about their ability to solve a problem and communicate understanding of the 
process. 
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Appendix A 



NAEP Mathematics Achievement Level Descriptions 
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Grade 4 
Basic 



Proficient 



Advanced 



Fourth-grade students performing at the Basic level should show 
some evidence of understanding the mathematical concepts and 
procedures in the five NAEP content areas. 

Fourth graders performing at the Basic level should be able to estimate 
and use basie faets to perform simple eomputations with whole numbers; 
show some understanding of fraetions and deeimals; and solve some 
simple real-world problems in all NAEP eontent areas. Students at this 
level should be able to use — though not always aeeurately — four-funetion 
ealeulators, rulers, and geometrie shapes. Their written responses are often 
minimal and presented without supporting information. 

Fourth-grade students performing at the Proficient level should 
consistently apply integrated procedural knowledge and conceptual 
understanding to problem solving in the five NAEP content areas. 

Fourth graders performing at the Proficient level should be able to use 
whole numbers to estimate, eompute, and determine whether results are 
reasonable. They should have a eoneeptual understanding of fraetions and 
deeimals; be able to solve real-world problems in all NAEP eontent areas; 
and use four-funetion ealeulators, rulers, and geometrie shapes 
appropriately. Students performing at the Proficient level should employ 
problem-solving strategies sueh as identifying and using appropriate 
information. Their written solutions should be organized and presented 
both with supporting information and explanations of how they were 
aehieved. 

Fourth-grade students performing at the Advanced level should apply 
integrated procedural knowledge and conceptual understanding to 
complex and non-routine real-world problem solving in the five 
NAEP content areas. 

Fourth graders performing at the Advanced level should be able to solve 
eomplex non-routine real-world problems in all NAEP eontent areas. They 
should display mastery in the use of four-funetion ealeulators, rulers, and 
geometrie shapes. These students are expeeted to draw logieal eonelusions 
and justify answers and solution proeesses by explaining why, as well as 
how, they were aehieved. They should go beyond the obvious in their 
interpretations and be able to eommunieate their thoughts elearly and 
eoneisely. 
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Grade 8 

Basic Eighth-grade students performing at the Basic level should exhibit 

evidence of conceptual and procedural understanding in the five 
NAEP content areas. This level of performance signifies an 
understanding of arithmetic operations — including estimation — on 
whole numbers, decimals, fractions, and percents. 

Eighth graders performing at the Basic level should eomplete problems 
correetly with the help of structural prompts such as diagrams, charts, and 
graphs. They should be able to solve problems in all NAEP content areas 
through the appropriate selection and use of strategies and technological 
tools, including calculators, computers, and geometric shapes. Students at 
this level also should be able to use fundamental algebraic and informal 
geometric concepts in problem solving. As they approach the Proficient 
level, students at the Basic level should be able to determine which of the 
available data are necessary and sufficient for correct solutions and use 
them in problem solving. However, these eighth graders show limited skill 
in communicating mathematically. 

Proficient Eighth-grade students performing at the Proficient level should apply 
mathematical concepts and procedures consistently to complex 
problems in the five NAEP content areas. 

Eighth graders performing at the Proficient level should be able to 
conjecture, defend their ideas, and give supporting examples. They should 
understand the connections among fractions, percents, decimals, and other 
mathematical topics such as algebra and functions. Students at this level 
are expected to have a thorough understanding of Basic level arithmetic 
operations — an understanding sufficient for problem solving in practical 
situations. Quantity and spatial relationships in problem solving and 
reasoning should be familiar to them, and they should be able to convey 
underlying reasoning skills beyond the level of arithmetic. They should be 
able to compare and contrast mathematical ideas and generate their own 
examples. These students should make inferences from data and graphs, 
apply properties of informal geometry, and accurately use the tools of 
technology. Students at this level should understand the process of 
gathering and organizing data and be able to calculate, evaluate, and 
communicate results within the domain of statistics and probability. 

Advanced Eighth-grade students performing at the Advanced level should be 

able to reach beyond the recognition, identification, and application of 
mathematical rules in order to generalize and synthesize concepts and 
principles in the five NAEP content areas. 

Eighth graders performing at the Advanced level should be able to probe 
examples and counterexamples in order to shape generalizations from 
which they can develop models. Eighth graders performing at the 
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Advanced level should use number sense and geometrie awareness to 
consider the reasonableness of an answer. They are expected to use 
abstract thinking to create unique problem-solving techniques and explain 
the reasoning processes underlying their conclusions. 
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Appendix B 

Mathematical Complexity Items Scoring Guide 
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Low Complexity 

How many fourths make a whole? 

Answer: 

Source: 1996 NAEP (grade 4) Pereent eorreet: 50 



Scoring Guide 




+ 6 + -12 = 

*A. -6 

B. +6 

C. -18 

D. +18 

Source: 1990 NAEP (grade 8) Pereent eorreet: 68 

N stands for the number of stamps John had. He gave 12 stamps to his sister. 
Whieh expression tells how many stamps John has now? 

A.N+ 12 
*B. A- 12 

C. 12-A 

D. 12x A 

Source: 1996 NAEP (grade 4) Pereent eorreet: 67 



How many hours are equal to 150 minutes? 

A. H/2 

B. 2% 

C. 2'h 
*D. 21/2 

E. 276 

Source: 1990 NAEP (grade 12) Pereent eorreet: 74 
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What is the weight shown on the scale? 

A. 6 pounds 

B. 7 pounds 

C. 51 pounds 
*D. 60 pounds 

Source: 1992 NAEP (grade 4) Percent correct: 44 



Moderate Complexity 

The following shapes were provided to students. (Shapes were larger than shown.) 




(Grade 8 version) 



Bob, Carmen, and Tyler were comparing the areas of N and P. Bob said that N and P 
have the same area. Carmen said that the area of N is larger. Tyler said that the area of 
P is larger. 

Who was correct? 

Use words or pictures (or both) to explain why. 

Source: 1996 NAEP (grade 8) Percent correct: 27 
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Scoring Rubic 
1 - Correct 

An adequate explanation with or without Bob. 

May say “neither” or “both.” 

Parts of P overlap N, and part stieks out. The stieking out part is equal to the left out part of 
N. 




OR 



Two P’s mateh two N’s therefore they have the same area. (Therefore, one N has the same 
area as one P.) 





N 







OR 



Areas are equal beeause height of P is the same as the height of N, and the base of P is 
twiee the base of N. 




OR 



Either of these two figures alone are aeeeptable 
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Scoring Rubric (continued) 

1 - Correct 

Correct response (see page 61). 

0 - Incorrect 

Bob was correct, but explanation not given or inadequate Any response that answers 
Carmen or Tyler to “Who was correct?” or omits the name and gives no satisfactory 
explanation. 




In this figure, how many small cubes were put together to form the large cube? 
A. 7 
*B. 8 

C. 12 

D. 24 



Source: 1996 NAEP (grade 4) Percent correct: 33 



From any vertex of a 4-sided polygon, 1 diagonal can be drawn. 

From any vertex of a 5-sided polygon, 2 diagonals can be drawn. 

From any vertex of a 6-sided polygon, 3 diagonals can be drawn. 

From any vertex of a 7-sided polygon, 4 diagonals can be drawn. 

How many diagonals can be drawn from any vertex of a 20-sided polygon? 

Answer: 

Source: 1996 NAEP (grade 8) Percent correct: 54 
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Scoring Guide 



Scoring Rubric 



1 - Correct 

17 

Number of diagonals is always 3 less than the number of sides. 



0 - Incorrect 

Any incorrect response. 



Tracy said, “I can multiply 6 by another number and get an answer that is smaller than 
6 .” 

Pat said, “No, you can’t. Multiplying 6 by another number always makes the answer 6 
or larger.” 

Who is correct? Give a reason for your answer. 

Source: 1992 NAEP (grades 8 and 12) Percent correct: 49 (grade 8); 63 (grade 12) 

Scoring Guide 

Scoring Rubric 
1 - Correct 

Tracy, with correct answer given. 

OR 

No name stated but reason given is correct. 

Examples of correct reasons: 

• If you multiply by a number smaller than 1 the result is less than 6. 

• 6x0 = 0 

• 6 X 1/2 = 3 

• 6 X -1 = -6 

0 - Incorrect 

Tracy with no reason. 

OR 

Any response that states Pat is correct. 

OR 

No name stated and reason given is incorrect. 
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High Complexity 

A pattern of dots is shown below. At eaeh step, more dots are added to the pattern. 
The number of dots added at eaeh step is more than the number added in the previous 
step. The pattern eontinues infinitely. 



(1st step) 



• • 

2 Dots 



(2nd step) 

• • • 
• • • 

6 Dots 



(3rd step) 

• • • • 
• • • • 
• • • • 

12 Dots 



Marcy has to determine the number of dots in the 20th step, but she does not want to 
draw all 20 pictures and then count the dots. Explain or show how she could do this 
and give the answer that Marcy should get for the number of dots. 

Source: 1992 NAEP (grade 8) Percent correct: 6 



Scoring Guide 

Explanation should include one of the following ideas with no false statements. 



a. Eor each successive step, the number of rows and the number of columns is increasing 
by 1, forming a pattern. Eor example, the first step forms 1 by 2 rows and columns, the 
next step 2 by 3, the third step 3 by 4, and so on. Continuing this pattern would mean 
that the 20th step has 20 by 21 or 420 dots. 

b. Eook at the successive differences between the consecutive steps. The differences 4, 6, 

8, 10,. . .form a pattern. There are 19 differences forming the pattern 4, 6, 8, 10,. . .38, 40 
and the sum is (9 x 44) + 22 or 418. However, 2 must be added for the first step, yielding 
a response of 420. 
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Scoring Rubric 
4 - Extended 

Correct answer. (Must state 420; must tie step 20 back to beginning of pattern in some 
specific form of generalization.) 

3 - Satisfactory 

Correct explanation of pattern but does not include or omits the correct number of dots. 

2 - Partial 

A partial (incomplete) correct explanation, i.e., does not tie together. 

1 - Minimal 

Any attempt to generalize OR to draw all 20 pictures in the pattern (with a clear 
understanding of the pattern). 

0 - Incorrect 

The work is completely incorrect, irrelevant, or off 



Jaime knows the following facts about points A, B, and C. 

• Points A, B, and C are on the same line, but might not be in that order. 

• Point C is twice as far from point A as it is from point B. 

Jaime concluded that point C is always between points A and B. 

Is Jaime’s conclusion correct? 

CD Yes CD No 

In the space provided, use a diagram to explain your answer. 

Source: 1996 NAEP (grade 8) Percent correct: 23 
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Scoring Guide 



The explanation must include either one 


of the following diagrams: 


♦ 


• 


• — 


c 


B 


A 




or 




• 


• 


« — 


A 


B 


C 


Diagram should include or illustrate the idea that B 


is halfway between A and C. 



Scoring Rubric 
1 - Correct 

Correct response. Both correct diagrams are given 
OR 

If correct diagram is clearly indicated either by circling and/or the incorrect ones are 
crossed out. 

0 - Incorrect 

Any incorrect reason OR if there is no indication of which diagram is correct (by circling 
or crossing out incorrect one). 

NOTE: Points need to be indicated by some mark, such as a dot or tick mark. A response in which points 
are indicated by letters only is an automatic incorrect. 




In Mr. Bell’s classes, the students voted for their favorite shape for a symbol. 
Here are the results. 





Class 1 


Class 2 


Class 3 


Shape N 


9 


14 


11 


Shape P 


1 


9 


17 


Shape Q 


22 


7 


2 
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Using the information in the ehart, Mr. Bell must seleet one of the shapes to be the 
symbol. Whieh one should he seleet and why? 

The shape Mr. Bell should seleet: 

Explain: 

Source: 1996 NAEP (grades 4 and 8) Pereent eorreet: 31 (grade 4); 58 (grade 8) 

Scoring Guide 

Scoring Rubric 
1 - Correct 

N, because more students chose it. 

OR 

N, because it was first choice in one class and second choice in the other classes. 
“Majority” is acceptable (taken to mean most). If student says most classes, do not accept. 



0 - Incorrect 

Shape Q chosen, with an explanation that refers to a number of votes 
OR 

Shape N chosen, but explanation not given or is inadequate with incorrect computation. 
OR 

Any other incorrect response. 
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Appendix C 



NAEP Mathematics Project Staff and Committees 
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